What Makes a Good Match? Predictors of Quality Mentorship Among Doctoral Students.

Quality mentoring promotes graduate student success. Despite an abundance of practical advice, empirical evidence regarding how to match mentees and mentors to form quality mentoring relationships is lacking. Here, we examine the influence of variables theorized to predict mentorship support and quality in a national sample of 565 science doctoral students from 70 universities in 38 states. Our structural equation modeling results indicate that mentor rank, mentee capital, and the relationship matching mechanism (direct admissions, rotations) were not associated with higher-quality relationships. We found no support for the widely held belief that students whose mentors shared their gender, race, or ethnicity experienced greater mentorship quality. Rather, mentees who shared attitudes, beliefs, and values with their mentor, or whose mentors displayed greater cultural awareness experienced more supportive, higher quality mentoring. Furthermore, these patterns were largely consistent across both mentee and mentor demographic groups. These results highlight the potential benefits of pairing mentees and mentors who share personal and intrinsic qualities rather than demographic or surface-level attributes. Our findings also indicate that graduate students from marginalized backgrounds can be effectively mentored by faculty who are demographically dissimilar if their mentors engage in culturally aware mentorship.

An integrative review of parent education approaches in sport: Considerations for program planning and evaluation.

In recent years, there has been an increase in the delivery and evaluation of parent education programs within youth sport. Subsequently, some recent reviews of these programs have been conducted. However, one consistent issue across many of the programs and associated review papers is the lack of an appropriate evaluation framework to guide the planning or associated reporting of the outcomes of the interventions. This has limited understanding of the overall impact of sport parenting interventions. Thus, the purposes of the current study were as follows: (a) to identify commonalities in the reporting and evaluation of parent education programs; (b) to identify gaps in the reporting and evaluation of parent education programs; (c) to draw these insights together to provide suggestions regarding how the RE-AIM could be used to enhance planning and evaluation of evidence-based programs for parent education in sport. Specifically, utilizing the RE-AIM framework to provide insights into pertinent evaluation metrics, this integrative review aimed to identify commonalities and gaps in the reporting of parent education programs. The RE-AIM framework considers the essential elements to assess the external and internal validity of interventions through five dimensions: Reach, Effectiveness, Adoption, Implementation, and Maintenance (Am J Public Health. 1999;89(9):1322-1327). Subsequently, the review aimed to provide suggestions regarding strategies to enhance the planning and evaluation of evidence-based programs for parent education in sport. Overall, the analysis demonstrated that most studies presented some pertinent evaluation information related to the RE-AIM framework, such as the number of participants and contacts made, the measures used, and the program level. However, the studies also lacked information on participant exclusion criteria, the method used to select the delivery agent (e.g., parents engaged in the program), and cost measures. Overall, the current study identified various areas where programs could be enhanced, specifically related to reporting procedural elements (e.g., program design, target population, and costs) pertaining to the implementation of parent education programs.

Outcome evaluation of the p drivers Program: Randomised controlled trial of a program to improve safe driving among novice drivers.

BACKGROUND: Globally, road traffic crashes are the leading cause of death for young adults. The P Drivers Project was a trial of a behavioural change program developed for, and targeted at, young Australian drivers in their initial months of solo driving when crash risk is at its highest. METHODS: In a parallel group randomised controlled trial, drivers (N = 35,109) were recruited within 100 days of obtaining their probationary licence (allowing them to drive unaccompanied) and randomised to an intervention or control group. The intervention was a 3 to 6-week multi-stage driving behaviour change program (P Drivers Program). Surveys were administered at three time points (pre-Program, approximately one month post-Program and at 12 months after). The outcome evaluation employed an on-treatment analysis comprising the 2,419 intervention and 2,810 control participants who completed all required activities, comparing self-reported crashes and police-reported casualty crashes (primary outcome), infringements, self-reported attitudes and behaviours (secondary outcomes) between groups. RESULTS: The P Drivers Program improved awareness of crash risk factors and intentions to drive more safely, relative to the controls; effects were maintained after 12-months. However, the Program did not reduce self-reported crashes or police-reported casualty crashes. In addition, self-reported violations, errors and risky driving behaviours increased in the intervention group compared to the control group as did recorded traffic infringements. This suggests that despite the Program increasing awareness of risky behaviour in novice drivers, behaviour did not improve. This reinforces the need to collect objective measures to accompany self-reported behaviour and intentions. CONCLUSIONS: The P Drivers Program was successful in improving attitudes toward driving safety but the negative impact on behaviour, lack of effect on crashes, and the large loss to follow-up fail to support the use of a post-licensing behaviour change program to improve novice driver behaviour and reduce crashes. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry: 363,293 (ANZCTR, 2012).

Effect of a Legal Clinic Program Within an Urban Primary Health Care Center on Social Determinants of Health: A Program Evaluation.

BACKGROUND: Individuals living in poverty often visit primary healthcare clinics for health problems stemming from unmet legal needs. We examined the impact of a medical-legal partnership on improving the social determinants of health (SDoH), health-related quality of life, and perceived health status of attendees of a Legal Clinic Program (LCP). METHODS: This was a pre-post program evaluation of a weekly LCP established within an urban primary healthcare clinic to provide free legal consultation. Patients aged 18 years or older were either approached or referred to complete a screening tool to identify potential legal needs. Those identified with potential legal needs were offered an appointment with LCP lawyers who provided legal counsel, referrals, and services. For those who attended the LCP, changes in SDoH and health indicators were collected via a self-reported survey 6 months after they attended the LCP and compared to their baseline scores using paired t-tests, McNemar's test for paired proportions, and the Wilcoxon Signed Rank Test for related samples. RESULTS: During the 6-month evaluation period, 31 participants attended the LCP and completed both the baseline and 6-month surveys; 67.8% were female, 64.5% were white, 90.3% were not working full-time, and 61.3% had a household income of $700 to 1800 per month. At follow-up, 25.8% were receiving at least 1 new benefit and there was a statistically significant reduction in food insecurity (35.5% vs 9.7%, P < .05). Also, perceived health status using the visual analog scale (ranges from 0 to 100) significantly improved from 42.5 points (SD = 25.3) at baseline to 56.6 points (SD = 19.6) after 6 months (P < .05). CONCLUSIONS: The LCP has the potential to improve the health and wellbeing of patients in primary healthcare clinics by addressing unmet legal needs and SDoH.

Statistical estimation of fatal and serious injuries saved by iRAP protocols in 74 countries.

OBJECTIVE: Road traffic crashes cause 1.19 million deaths and millions more injuries annually. The persistently high burden has drawn attention from national and international stakeholders worldwide. Unsafe road infrastructure is one of the major risk factors for traffic safety, particularly in low- and middle-income countries. METHODS: Aiming to eliminate high-risk roads in all countries, the International Road Assessment Programme (iRAP) developed a robust and evidence-based approach to support country transportation agencies. RESULTS: Thus far, the iRAP protocols have been used to collect 1.8 million kilometers of Crash Risk Mapping and 1.5 million kilometers of Star Rating and FSI estimations in 128 countries. Deploying an observational before-and-after (or pre-post) study design, this report estimated the fatal and series injuries (FSI) saved through use of the iRAP protocols. The study is based on 441,753 kilometers of assessed roads from 1,039 projects in 74 countries. Our results show that the implementation of iRAP's proposed countermeasures saves about 159,936 FSI annually. Throughout the lifetime of the implemented countermeasures, a total of 3.2 million FSI could be saved. CONCLUSION: While quantifying the success of the iRAP protocols, our results suggest an opportunity to save many millions more lives on the roads through expanding iRAP implementation to more regions and countries.

A proposal to evaluate the management of tuberculosis programs: a qualitative, evaluability assessment in the border region of Brazil and Venezuela.

This study aims to analyze the feasibility of building an evaluative model for the management of the Tuberculosis Prevention and Control Program in the State of Roraima, located on the border between Brazil and Venezuela. This is an evaluability assessment, a type of study used as a pre-evaluation of the development and implementation stages of a program, as well as throughout its execution. The study was developed in stages comprising the: (i) definition of the intervention to be analyzed and its objectives and goals; (ii) construction of the intervention logical model; (iii) screening of parties interested in the evaluation; (iv) definition of the evaluative questions; and (v) design of the evaluation matrix. Four priority components were defined for the evaluation: management of the organization and implementation of tuberculosis (TB) prevention and control policy; epidemiological surveillance management; care network management; and management of expected/achieved results. In this model, and based on theoretical references, we defined the necessary resources, activities, outputs, outcomes, and the expected impact for each of the policy management components. The management of the TB control program is feasible for evaluation based on the design of its components, the definition of structure and process indicators, and relevant results for the analysis of the management of TB prevention and control actions, as well as its influence on compliance with the agreed indicators and targets aiming at eradicating the disease by 2035.

Feasibility of a quality-improvement program based on routinely collected health outcomes in Dutch primary care physical therapist practice: a mixed-methods study.

BACKGROUND: This study evaluates the feasibility of a nine-month advanced quality-improvement program aimed at enhancing the quality of care provided by primary care physical therapists in the Netherlands. The evaluation is based on routinely collected health outcomes of patients with nonspecific low back pain, assessing three feasibility domains: (1) appropriateness, feasibility, and acceptability for quality-improvement purposes; (2) impact on clinical performance; and (3) impact on learning and behavioral change. METHODS: A mixed-methods quality-improvement study using a concurrent triangulation design was conducted in primary care physical therapist practice. Feedback reports on the processes and outcomes of care, peer assessment, and self-assessment were used in a Plan-Do-Study-Act cycle based on self-selected goals. The program's appropriateness, feasibility, and acceptability, as well as the impact on clinical performance, were evaluated using the Intervention Appropriate Measure, Feasibility Intervention Measure, Acceptability Intervention Measure (for these three measure, possible scores range from 4 to 20), and with a self-assessment of clinical performance (scored 0-10), respectively. The impact on learning and behavioral change was evaluated qualitatively with a directed content analysis. RESULTS: Ten physical therapists from two practices participated in this study. They rated the program with a mean of 16.5 (SD 1.9) for appropriateness, 17.1 (SD 2.2) for feasibility, and 16.4 (SD 1.5) for acceptability. Participants gave their development in clinical performance a mean score of 6.7 (SD 1.8). Participants became aware of the potential value of using outcome data and gained insight into their own routines and motivations. They changed their data collection routines, implemented data in their routine practice, and explored the impact on their clinical behavior. CONCLUSIONS: This explorative study demonstrated that a quality-improvement program, using health outcomes from a national registry, is judged to be feasible. IMPACT STATEMENT: This study provides preliminary evidence on how physical therapists may use health outcomes to improve their quality, which can be further used in initiatives to improve outcome-based care in primary physical therapy.

Evaluating the Impact and Effectiveness of Flint's Community Ethics Review Board (CBOP-CERB): A Pilot Study.

In recognition of the importance of evaluation for funding, research, and quality improvement, a longstanding Community Advisory Board in Flint Michigan embarked on a process to evaluate their impact. The Community-Based Organization Partners (CBOP)-Community Ethics Review Board (CERB) engaged a research team composed of an academic researcher (Solomon Cargill) and a community partner (Spencer) to obtain funding, design and implement an evaluation of the CBOP-CERB. This evaluation study yielded two evaluations of the CBOP-CERB, one with researchers who had engaged with the CBOP-CERB and the other with Flint area community residents. The results of these two evaluations can serve to show other Community Advisory Boards how to establish and expand their impact, establish their worth for future funding, and how to articulate, evaluate, and achieve their goals.

Community Health Workers Deliver Mental Health Intervention to Uninsured Latinx in Baltimore: Evaluation and Lessons Learned in a Pilot Program.

BACKGROUND: Implementation of evidence-based interventions to reduce depression among uninsured Latinx patients who are at high risk of depression are rare. OBJECTIVES: Our goal was to evaluate Strong Minds, a language and culturally tailored, evidence-based intervention adapted from cognitive behavioral therapy (CBT) for mild-moderate depression and anxiety, delivered by community health workers (CHWs) in Spanish to uninsured Latinx immigrants. METHODS: As part of the pilot, 35 participants, recruited from a free community primary care clinic, completed Strong Minds. Assessments and poststudy interviews were conducted. Paired t-tests were used to assess change of depressive symptoms at 3 and 6 months. LESSONS LEARNED: CHW delivery of depression care to this population was feasible and among those who completed the program, preliminary evidence of depression outcomes suggests potential benefit. CHWs had specific training and support needs related to mental health care delivery. CONCLUSIONS: Further implementation studies of depression care interventions using CHWs for underserved Latinx is needed.

Program Evaluation's Path to Greater Policy Relevance: Learning From Rossi's Iron Laws.

In a 1987 article, Peter R. Rossi promulgated "The Iron Law of Evaluation and Other Metallic Rules." The Metallic Laws were meant as an informal (and humorous) overstatement of the weakness of contemporary evaluations of social programs. Rossi' s underlying worry was not so much about the state of evaluation technology in the abstract, but, rather, in its inability to advance our broad understanding of social problems and what to do about them---in other words, to make evaluation policy relevant. Rossi attributed the continuing failure to develop successful "large-scale social programs" to the failure to build a strong knowledge base for this kind of "social engineering." The qualities of studies that enable such accumulated learning are variously labeled "external validity," "generalizability," "applicability," or "transferability." This Special Issue includes five papers that seek to explore and apply this understanding.

Program evaluation of a school-based mental health and wellness curriculum featuring yoga and mindfulness.

BACKGROUND: Interest in the effectiveness of mindfulness-based interventions such as yoga in primary schools has grown. Evidence shows promise, as youth who engage in yoga to promote mindfulness show improved coping skills, increased socio-emotional competence and prosocial skills, academic performance, attention span, and ability to deal with stress. OBJECTIVE: This study reports the results of a program evaluation of a universal health and wellness curriculum, Pure Power, designed to teach youth yoga techniques, mindfulness, and emotion regulation. METHODS: A non-randomized comparison design examined outcomes among participants from schools that completed the intervention with highest fidelity of implementation (n = 461) and from students in matched comparison schools (n = 420). Standard measures of coping, emotion regulation and emotion dysregulation, spelling, and math achievement were collected. RESULTS: Analyses suggest the youth in the intervention schools demonstrated relative improvement on measures of emotion regulation, spelling, and math. CONCLUSIONS: Challenges in implementation in real-life settings are vital to identify. The data provide some real-world evidence for the effectiveness of a universal health and wellness curriculum on emotion regulation and positive academic outcomes. Training school staff to deliver the intervention may foster implementation. Future research should test the effectiveness of who delivers the intervention; for example, teacher-delivered groups vs. other wellness personnel.

A mixed methods evaluation of the impact of ECHO® telementoring model for capacity building of community health workers in India.

INTRODUCTION: India has the largest cohort of community health workers with one million Accredited Social Health Activists (ASHAs). ASHAs play vital role in providing health education and promoting accessible health care services in the community. Despite their potential to improve the health status of people, they remain largely underutilized because of their limited knowledge and skills. Considering this gap, Extension for Community Healthcare Outcomes (ECHO)® India, in collaboration with the National Health System Resource Centre (NHSRC), implemented a 15-h (over 6 months) refresher training for ASHAs using a telementoring interface. The present study intends to assess the impact of the training program for improving the knowledge and skills of ASHA workers. METHODS: We conducted a pre-post quasi-experimental study using a convergent parallel mixed-method approach. The quantitative survey (n = 490) assessed learning competence, performance, and satisfaction of the ASHAs. In addition to the above, in-depth interviews with ASHAs (n = 12) and key informant interviews with other stakeholders (n = 9) examined the experience and practical applications of the training. Inferences from the quantitative and qualitative approaches were integrated during the reporting stage and presented using an adapted Moore's Expanded Outcomes Framework. RESULTS: There was a statistically significant improvement in learning (p = 0.038) and competence (p = 0.01) after attending the training. Participants were satisfied with the opportunity provided by the teleECHO™ sessions to upgrade their knowledge. However, internet connectivity, duration and number of participants in the sessions were identified as areas that needed improvement for future training programs. An improvement in confidence to communicate more effectively with the community was reported. Positive changes in the attitudes of ASHAs towards patient and community members were also reported after attending the training. The peer-to-peer learning through case-based discussion approach helped ensure that the training was relevant to the needs and work of the ASHAs. CONCLUSIONS: The ECHO Model ™ was found effective in improving and updating the knowledge and skills of ASHAs across different geographies in India. Efforts directed towards knowledge upgradation of ASHAs are crucial for strengthening the health system at the community level. The findings of this study can be used to guide future training programs. Trial registration The study has been registered at the Clinical Trials Registry, India (CTRI/2021/10/037189) dated 08/10/2021.

Development, implementation, and evaluation of an undergraduate family medicine program in the United Arab Emirates.

BACKGROUND: Healthcare systems rely on well-trained family medicine physicians who can offer continuous quality services to their communities and beyond. The American Academy of Family Physicians and the World Organization of Family Doctors recommend that medical curricula should have adequately supervised education and training of the learners in family medicine during their preclinical and clinical placements. However, some medical schools don't have a comprehensive family medicine program to prepare graduates who can meet the community needs. This work aims to report the essential steps for the development, implementation, and evaluation of the family medicine program at the College of Medicine at the University of Sharjah in United Arab Emirates. METHODS: We used the Kern's 6-step model to describe the development, implementation, and evaluation of the family medicine program. This includes problem identification, needs assessment, goals setting, educational strategies, implementation, and evaluation. During 2014-2022, we longitudinally collected essential information about the family medicine program from different stakeholders including the feedback of clinical coordinators, adjunct clinical faculty, and medical students at the end-of-clerkship. All responses were analysed to determine the effective implementation and evaluation of the family medicine program. RESULTS: Over the course of 8 academic years, 804 medical students, 49 adjunct clinical faculty and three College of Medicine faculty participated in the evaluation of the family medicine program. The majority of respondents were satisfied with various aspects of the family medicine program, including the skills gained, the organisation of program, and the variety of clinical encounters. The medical students and adjunct clinical faculty suggested the inclusion of e-clinics, faculty development program, and the expansion of more clinical sites for the effectiveness of the family medicine program. CONCLUSIONS: We report a successful development, implementation, and evaluation of the family medicine program in United Arab Emirates with a positive and impactful learning experience. More attention should be paid towards a suitable representation of family medicine program in the medical curriculum with focused and targeted educational plans for medical students.

Applying Concepts of Curriculum Design and Cultural Adaptation: Collaborating on a Dual-Degree Occupational Therapy Program in Mainland China.

Occupational therapy is a profession with origins rooted in Western values. As culture plays an important role in shaping theory and practice, the curriculum design of academic programs that train future rehabilitation professionals should reflect the local context. As part of an international partnership, a dual-degree graduate program in occupational therapy was established between a Chinese and an American university. A team composed of members from both institutions collaborated on culturally adapting an entry-level master's program in occupational therapy for China, based on a U.S. program, which welcomed its first cohort in September 2019. This article details the timeline and process of program design and adaptation from conception, through implementation to evaluation and revision, with the aim of offering a framework for curriculum adaptation of other academic programs in the U.S. and internationally. The adapted curriculum includes the program mission, vision, and philosophy; the curriculum model with program outcomes and threads; the program scope and sequence; materials and resources; and course-specific objectives, learning activities, and assessments. The authors also share lessons learned through this experience of international collaboration as well as next steps for program evaluation and sustainability. The detailed overview of this international collaboration offers suggestions for individuals and institutions seeking to develop global partnerships and adapt curricula across cultural contexts.

Supporting re-engagement with HIV services after treatment interruption in South Africa: a mixed method program evaluation of MSF's Welcome Service.

Psychosocial challenges impact patients' ability to remain on antiretroviral therapy lifelong, magnified by disorganized health-systems and healthcare worker (HCW) attitudes. To address this, Médecins Sans Frontières and the Department of Health developed the Welcome Service intervention, to provide person-centered care at re-engagement after HIV treatment interruption. Implemented in Khayelitsha, South Africa, between August 2020 and February 2021, the intervention aimed to reorganize triage, optimize clinical and counselling services and address HCW attitudes. The study used a mixed-methods design, incorporating in-depth interviews, and analyses of programmatic and routine health data. Interviews demonstrated positive patient care experiences. HCWs understood the potential impact of attitudes on patient engagement, however, some continued to demonstrate judgmental attitude. Clinical objectives were variably met at re-engagement: 98% were re-initiated the same day, 50% had a CD4 done, and 45% received tuberculosis prevention. Nevertheless, 4-month retention was 66%, and 88% had a VL < 1000 c/mL. Despite HCWs' understanding of person-centered care not translating into supportive behaviors, patients had positive care experiences and the intervention ended with a high rate of VL suppression. More efforts are needed to design interventions building on Welcome Service principles to provide person-centered care and sustain retention after re-engagement.

Direct Admission Program Implementation: A Qualitative Analysis of Variation Across Health Systems.

OBJECTIVES: Direct admission (DA) to the hospital has the potential to improve family satisfaction and timeliness of care by bypassing the emergency department. Using the RE-AIM implementation framework, we sought to characterize variation across health systems in the reach, effectiveness, adoption, and implementation of a DA program from the perspectives of parents and multidisciplinary clinicians. METHODS: As part of a stepped-wedge cluster randomized trial to compare the effectiveness of DA to admission through the emergency department, we evaluated DA rates across 69 clinics and 3 health systems and conducted semi-structured interviews with parents and clinicians. We used thematic analysis to identify themes related to the reach, effectiveness, adoption, and implementation of the DA program and applied axial coding to characterize thematic differences across sites. RESULTS: Of 2599 hospitalizations, 171 (6.6%) occurred via DA, with DA rates varying 10-fold across health systems from 0.9% to 9.3%. Through the analysis of 137 interviews, including 84 with clinicians and 53 with parents, we identified similarities across health systems in themes related to perceived program effectiveness and patient and family engagement. Thematic differences across sites in the domains of program implementation and clinician adoption included variation in transfer center efficiency, trust between referring and accepting clinicians, and the culture of change within the health system. CONCLUSIONS: The DA program was adopted variably, highlighting unique challenges and opportunities for implementation in different hospital systems. These findings can inform future quality improvement efforts to improve transitions to the hospital.